Papers with token-level F1 score
From Short Video to Clickable Search: RLVR-Enabled Listwise Query Suggestion with Retrieval-Augmented Context (2026.acl-industry)
Copied to clipboard
| Challenge: | Existing methods to generate short-video bottom-bar queries are largely retrieval-based. |
| Approach: | They propose to reformulate the task as one-shot list generation, producing multiple queries per video . they also build multi-query ground truth from exposure and CTR logs, and redesign offline evaluation . |
| Outcome: | The proposed system yields strong offline and online improvements . it is deployed on Kuaishou to serve hundreds of millions of users daily . |
Keyphrase Generation with Fine-Grained Evaluation-Guided Reinforcement Learning (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing KG evaluation metrics are only aware of the exact correctness of predictions on phrase-level and ignore semantic similarities between similar predictions and targets, which inhibits the model from learning deep linguistic patterns. |
| Approach: | They propose a fine-grained evaluation metric to improve the previous KG framework . the evaluation metrics are only aware of the exact correctness of predictions on phrase-level . |
| Outcome: | The proposed method outperforms the existing frameworks among all evaluation scores. |
Event-Centric Question Answering via Contrastive Learning and Invertible Event Transformation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing QA frameworks that use event-centric reasoning are lacking. |
| Approach: | They propose a novel QA model with contrastive learning and invertible event transformation . they use an invertable transformation matrix to project event vectors into a common event embedding space . |
| Outcome: | The proposed model achieves 8.4% gain in token-level F1 score and 3.0% gain in Exact Match score on the ESTER dataset. |